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£5 (57) Abstract: A device for forming an image on a screen (50) is described that comprises a coherent illumination means(42), an 
O electrically addressed spatial light modulator means (46) located in the path of light from the coherent illumination means, means 
^ for producing computer generated hologram images (49) for display on the electrically addressed spatial light modulator means, and 
Q optics (44) to direct light diffracted by the electrically addressed spatial light modulator means to the screen (50). The device is 
^ arranged so that a computer generated image or images displayed by the electrically addressed spatial light modulator means result 
in a two dimensional image being formed at the screen. 



WO 2004/066037 Al iiiiniiiifliii«iniiiiiiii»ieiiiiiuiii 



Declaration under Rule 4.17: 

— of inventorship ( Rule 4. I 7( iv)) for US only 

Published: 

— with international search report 

— before the expiration of the time limit for amending the 
claims and to he republished in the event of receipt of 
amendments 



For two-letter codes and other abbreviations, refer to the "Guid- 
ance Notes on Codes and Abbreviations" appearing at the begin- 
ning of each regular issue of the PCT Gazette. 




10/542491 



WO 2004/066037 \ f\ PCT/GB2O04/00O224 

i JC20 Rec'd PCT/PTO 1 5 JUL 2005 

Image projection device and method. \ 

This invention relates to an image projection device, and in particular to an image 
projection device for forming a two dimensional image on a screen. 

5 

Image projection devices, such as those use in lecture theatres etc, are well known. 
Typically, an image is written to an electrically addressed spatial light modulator 
(EASLM) and an optical arrangement projects a magnified image of the EASLM to 
a screen. Colour images can be readily formed using three EASLM channels to 
10 project red, green and blue images to the screen. 



Although conventional projection techniques are adequate to display television 
pictures and the like, the total number of pixels that can be displayed is limited to 
the number of EASLM pixels. Previously, images having a higher pixel count have 
15 been produced by using a number of separate projectors to build up sub-regions of 
an overall image. For example, the Department of Energy of the United State of 
America has developed a "high precision power wall" that uses a four-by-four arTay 
of projectors to produce a twenty-million colour pixel display that operates at video 
rate. 

The disadvantages of producing images by blending the outputs of a number of 
separate projector devices are numerous. For example, multi-projector systems 
typically produce noticeable artefacts at the boundaries of each projector's imaging 
area. Although attempts have been made to develop various software and hardware 
tools to minimise these unwanted artefacts, they have not proved particularly 
effective. Adjustment of the relative alignment of the projectors can also prove time 
consuming, and distortion introduced by the lenses will limit the degree of 
correction that is ultimately achievable. Furthermore, the colour balance of 
projectors will vary with time and ensuring colour uniformity across the image thus 
requires frequent re-calibration of the colour output of the projectors. 
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WO00/40018 demonstrates how a high complexity image may be sequentially 
written to an optically addressed spatial light modulator (OASLM) using a so-called 
active tiling system. The high complexity two dimensional image stored by the 
OASLM can then be projected to a screen. Alternatively, a computer generated 
5 hologram may be written to the OASLM and used to provide a three dimensional 
(also termed volumetric) image. A number of computational methods used to 
calculate CGHs are described in Cameron et. al., "Computational challenges of 
emerging novel true 3D holographic displays", paper 4109-23, presented at the SPIE 
conference on "Critical technologies for the future of computing", August, San 
10 Diego, USA. Published in proc. SPIE vol.4109. 

Systems of the type described in WO00/40018 are particularly advantageous when 
massive pixel counts are required from a spatial light modulator in order to form 
volumetric images. However, the multiple active tiling projection channels coupled 
15 with the need for an OASLM make such devices complex and costly making them 
unsuitable for use as two-dimensional image projectors. 

According to a first aspect of the present invention a device for forming an image on 
a screen comprises a coherent illumination means, an electrically addressed spatial 

20 light modulator means located in the path of light from the coherent illumination 
means, means for producing computer generated hologram images for display on the 
electrically addressed spatial light modulator means, and optics to direct light 
diffracted by the electrically addressed spatial light modulator means to the screen, 
wherein the computer generated image or images displayed by the electrically 

25 addressed spatial light modulator means result in a two dimensional image being 
formed at the screen. 

A device of the present invention thus writes a CGH pattern to the electrically 
addressed spatial light modulator means, and diffraction therefrom forms an image 
30 on the projection screen. The present invention thus uses diffraction from the 
electrically addressed spatial light modulator means to build up the required image 
at the screen. It should be noted that this effect is quite distinct to prior art two 
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dimensional projection systems where a copy of the image formed on an EASLM is 
projected (usually with some degree of magnification) to the screen. 

A person skilled in the art would recognise that the term computer generated 
5 hologram (CGH) image means an image that produces a required diffraction pattern 
when illuminated with coherent radiation. In effect a CGH image is a highly 
complex diffraction grating that is calculated using standard techniques in order to 
provide the required interference pattern at the screen. 

10 An advantage of devices of the present invention is the ability to tile multiple images 
without the unwanted blending effects and artefacts that are associated with typical 
prior art multiple projector devices. This benefit arises from producing and 
displaying computer generated hologram (CGH) images that can diffract light to any 
point on the two dimensional screen. Any non-uniformities or misalignment of the 

15 optical components making up the device can thus be compensated for by 
appropriate design of the CGH image. 

In particular, it has been found that the present invention does not require precise 
alignment of the electrically addressed spatial light modulator means with respect to 

20 the projection optics. The optical quality of the components making up the system 
may also be lower than those required in standard projection systems. In prior art 
devices, incoherent white light sources were typically employed as illumination 
means and coherent sources were avoided as they introduced unwanted interference 
effects. In contrast, the present invention uses diffraction to actually build up the 

25 required image at the screen. 

The present invention also has advantages over the active tiling systems described in 
WO00/40018. In particular, there is no requirement to provide an OASLM which 
reduces the overall cost of the device. 

30 

Conveniently, the electrically addressed spatial light modulator means comprises a 
plurality of electrically addressed spatial light modulators. 
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Forming the electrically addressed spatial light modulator means using a plurality of 
EASLMs enables a high pixel count to be attained. Unlike prior art systems, the 
present invention does not require each EASLM to be in precise alignment with the 

5 illumination and projection optics and with any adjacent EASLMs. The CGH image 
written to each EASLM can simply be adjusted so as to form the desired image or 
part of an image at the screen. For example, it would be possible to perform a 
calibration process prior to use of the system so that edge alignment effects are 
eliminated. The required pixel count may be provided by a small number of high 

10 complexity (e.g. 8 Megapixel) displays or by a larger number of lower complexity 
displays. 

Advantageously, the coherent illumination means illuminates the electrically 
addressed spatial light modulator means with red, green and blue light. The use of 
15 red, green and blue illumination allows a colour image to be formed at the screen. 
The use of more than these three colours of light would advantageously allow 
further extension of the colour gamut. 

Conveniently, the electrically addressed spatial light modulator means is 
20 sequentially illuminated by the coherent illumination means with red, green and blue 
light. In other words, a field sequential colour technique could be employed to build 
up the two dimensional colour image formed at the screen. 

Alternatively, separate portions of the electrically addressed spatial light modulator 
25 means are simultaneously illuminated by the coherent illumination means with red, 
green and blue light. In other words, different portions of the electrically addressed 
spatial light modulator means could be continuously illuminated with the different 
colours of light. For example, if the electrically addressed spatial light modulator 
means comprised three EASLMs it would be possible to illuminate each EASLM 
30 with light of a different colour. In this manner, a resultant two dimensional colour 
image could be formed. 
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Preferably, the frame rate of the electrically addressed spatial light modulator means 
is greater than the frame rate of the two dimensional image formed at the screen. 
The high update speeds of an electrically addressed spatial light modulator means 
can be used to build up a higher complexity image at the two dimensional screen. 

5 

As described above, the CGH may be calculated in many ways. Conveniently, the 
means for producing computer generated hologram images comprises a store of a 
plurality of pre-caiculated computer generated holographic elements or so-called 
"hogels" Each of these "hogels" is a diffraction pattern that generates a single pixel 
10 on the projection screen. These hogels can then be combined to create the required 
projected pattern. This greatly enhances the computation speed. 

Advantageously, the means for producing computer generated hologram images is 
configured to produce computer generated hologram images for display on the 
15 electrically addressed spatial light modulator means that provide a regular array of 
pixels on the screen. 

Although the electrically addressed spatial light modulator means may be written 
with a CGH image that provides diffraction to any point on the screen, it is preferred 
20 to form the two dimensional image from an array of pixels. For example, the two 
dimensional image may be constructed as a rectangular array of pixels. It would also 
be possible to provide certain areas of the screen having a higher pixel density than 
other. The use of such pixel arrays is especially advantageous when used in 
combination with pre-calculated CGH images. 

25 

Preferably, the array of pixels on the screen is sub-divided into blocks and the image 
at the screen is formed by sequentially writing one or more blocks to the screen. In 
this manner, the two dimensional image may be readily formed. 

30 Conveniently, the coherent illumination means comprises at least one laser. The use 
of a laser ensures colour uniformity across the display and a wide colour gamut. 
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This provides significant advantages over prior art systems that employ white light 
sources. 

Advantageously, additional magnification optics are provided such that a magnified 
5 two dimensional image may be formed at the screen. 

According to a second aspect of the present invention, a method of forming a two 
dimensional image on a screen comprising the steps of; (i) illuminating an 
electrically addressed spatial light modulator means with coherent light, (ii) 

10 displaying a computer generated hologram image on the electrically addressed 
spatial light modulator means so as to diffract light therefrom, and (iii) using optics 
to direct light diffracted by the electrically addressed spatial light modulator means 
to a screen, whereby the electrically addressed spatial light modulator means is 
arranged to display an image or images that produce a two dimensional image at the 

15 screen. 

The invention will now be described, by way of example only, with reference to the 
following drawings in which; 

20 figure 1 shows a typical prior art multiple channel projector system, 

figure 2 shows an image projection device according to the present invention, and 

figure 3 shows a schematic illustration of an image projection device of the present 
25 invention configured to provide a magnified image. 

Referring to figure 1, a prior art multiple channel projection device 2 is shown. 

The device 2 shown in figure la comprises a one dimensional array of colour 
30 projectors 4a-4c (collectively referred to as 4) that are co-located so as to each form 
a portion of an image displayed on the projection screen 6. The image to be 
displayed is produced by an appropriate image creation means 8, which may 
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comprise a video source, computer etc. A control means 10 is provided to divide the 
image into the separate portions that are to be displayed by each of the colour 
projectors 4. 

5 As shown in figure lb, each colour projector 4 comprises a white light source 12, 
three EASLMS 14a-14c, a red colour filter 16, a green colour filter 18 and a blue 
colour filter 20. The image displayed by each of the EASLMs is magnified and 
projected by the projection optics 22 to an image plane 24 where a colour image is 
formed. 

10 

The example described with reference to figure 1 illustrates a one dimensional array 
of colour projectors for simplicity. In reality, it is usual for a two dimensional array 
of colour projectors to be used. As described in more detail above, such multiple 
projector systems can prove difficult to align, tend to suffer from the presence of 
1 5 unwanted artefacts and exhibit non-uniformity of colour balance and intensity. 

Referring to figure 2, an image projection system 40 according to the present 
invention is shown. The image projection system comprises a source of coherent 
light 42, Fourier projection optics 44 and three EASLMs 46a-46c (collectively 
20 referred to as 46) each having an associated control means 48. An image source 
means 49 is also provided to produce the three separate colour images for display. 
The coherent light source 42 is arranged to direct red light to the EASLM 46a, green 
light to the EASLM 46b and blue light to the EASLM 46c. 

25 An array of colour "pixels" can be generated at the projection screen 50 by writing 
suitable computer generated hologram (CGH) images to the appropriate EASLM. In 
other words, diffraction from each pixel of each EASLM is used to produce the 
required arrangement of pixel(s) at the projection screen 50. For a given colour (i.e. 
for light of a given wavelength), each pixel on the projection screen is generated by 

30 a displaying a unique CGH pattern formed on the associated EASLM. 

It should be emphasised that writing a CGH pattern to the EASLM, and using 
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diffraction therefrom to form an image on the projection screen, is quite distinct to 
prior art two dimensional projection systems where a copy of the image formed on 
the EASLM is projected (usually with some degree of magnification) to the screen. 
The CGH image displayed by the EASLM in the present invention is very different 
5 to the two dimensional image that is formed at the screen. In fact, the skilled person 
would not be able to predict the particular image that will be produced at the screen 
by visual inspection of an image that has been written to the EASLM. 

The control means 48 calculates the CGH pattern that is written to the EASLM. The 
10 CGH pattern for specific projected pixels is commonly termed a 'hogel* and can be 
pre-computed and stored in a look up table. The hogel patterns that produce 
individual pixels at the projection screen can be combined to build up a resultant 
CGH pattern. The resultant CGH pattern provides a plurality of pixels at the at the 
screen in the desired pattern. More detail on the computation of appropriate CGH 
15 patterns can be found elsewhere, for example see Cameron et. al., "Computational 
challenges of emerging novel true 3D holographic displays", paper 4109-23, 
presented at the SPIE conference on "Critical technologies for the future of 
computing", August, San Diego, USA. Published in proc. SPIE vol.4109. 

20 In the system shown in figure 2, the image at the projection screen is built up in 
blocks. It should be noted that a block may contain any number of pixels; for 
example the block may comprise a line or several lines of pixels. Alternatively, each 
block may comprise pixels spaced across the projection screen. For low resolution 
images, it would also be possible for an image to be constructed from a single block. 

25 The number of pixels contained in each block also determines the number of hogels 
that need to be combined in order to produce the CGH image for display on the 
EASLM. The use of smaller block sizes thus decrease the computation effort 
required to calculate the required CGH pattern, but as block size decreases a greater 
number of blocks are obviously required to construct an image of a given 

30 complexity. 

To construct the required image, each of the colour blocks is displayed for a fraction 
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of the frame time. The pattern on the EASLM is then changed to illuminate another 
part of the projection screen. In this way, all of the screen is illuminated with all of 
the colours over one frame time. It is possible for one block of the screen to be 
illuminated by all three colour channels simultaneously. The pattern on each of the 
5 three EASLMs could then be re-written such that the illuminated block moves down 
the projection screen in steps until the whole frame image is built up. Alternatively, 
and as shown in figure 2, different blocks of the screen can be simultaneously 
illuminated with each colour. 

10 It is clear that each EASLM and associated control means must be capable of 
generating the required diffraction patterns in rapid succession. The type of update 
speed required can be estimated by considering the case of a system comprising a 
single EASLM. To obtain a colour image from such a system requires the use of 
field sequential colour techniques. 

15 

Let us say that the final desired display resolution is N pixels broken up into b 
blocks. Then each block has JM) pixels and N/b hogels must be combined to create 
the CGH pattern. Each block is illuminated in sequence to build up a frame, hence 
each frame must be fast in order to give the viewer a perception that the whole 

20 display is being illuminated. If the number of frames produced each second is f then 
the number of EASLM frames per second is given by f*b . This means that the total 
number of hogels that must be combined in each second is f*N. This result is 
independent of the block size and suggests that the only way to bypass the 
computational burden is to run computations in parallel. A typical field sequential 

25 colour frame rate is around two hundred frames per second, and thus for a ten 
million pixel image produced using a single EASLM around 2xl0 9 hogels must be 
combined per second. 

In a system with red, green and blue EASLM channels, each channel may act 
30 independently thereby cutting the frame rate per channel by a third and also reducing 
the computational burden per channel by one third. It is also possible consider a 
number of channels per colour, each dedicated to its own area of the projection 
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screen. This allows alignment of the sections to occur in software rather than 
hardware and also enables the hogel combination to occur in parallel thereby 
reducing further the computational burden per channel. If we consider three 
channels per colour, giving a total of nine EASLMs, then in the above example the 
5 number of hogel combination operations per channel would be about 2x10 . 

A system of the present invention also permits EASLMs that provide greyscale to be 
exploited to give a high diffraction efficiency, reduced computational load and lower 
power laser. An example of a fast greyscale liquid crystal EASLM is an electro- 
10 clinic device. Assuming that the EASLM device runs at a frame rate of 10 5 Hertz 
and that the overall device frame rate is 66Hz, then the number of blocks per image 
can be as high as fifteen-hundred. This is around two to three lines of a ten million 
pixel image. 

15 Referring to figure 3, an alternative arrangement of the present invention is shown 
which provides a magnified two dimensional image. In effect, the two dimensional 
screen of the device of figure 2 is replaced with a conjugate block 60. Projection 
optics 62 are also provided to magnify the image formed at the conjugate block to a 
larger two dimensional screen 64. In this manner, the magnification of the image can 

20 be readily controlled. 

Alternatively, the whole projected image could be projected simultaneously using a 
plurality of EASLMs. These could be conventional projection EASLMs running at a 
60Hz frame rate and split into three or more groups to give full colour. This has the 
25 advantage of allowing the use of commercial off the shelf components. 
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Claims. 

1. A device for forming an image on a screen comprising; 
a coherent illumination means, 

an electrically addressed spatial light modulator means located in the path of light from 
the coherent illumination means, 

means for producing computer generated hologram images for display on the electrically 
addressed spatial light modulator means, and 

optics to direct light diffracted by the electrically addressed spatial light modulator 
means to the screen, 

wherein the computer generated image or images displayed by the electrically addressed 
spatial light modulator means result in a two dimensional image being formed at the 
screen. 

2. A device according to claim 1 wherein the electrically addressed spatial light 
modulator means comprises a plurality of electrically addressed spatial light modulators. 

3. A device according to any one of the preceding claims wherein the coherent 
illumination means illuminates the electrically addressed spatial light modulator means 
with red, green and blue light. 

4. A device according to claim 3 wherein the electrically addressed spatial light 
modulator means is sequentially illuminated by the coherent illumination means with 
red, green and blue light 
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5. A device according to claim 3 wherein separate portions of the electrically 
addressed spatial light modulator means are simultaneously illuminated by the coherent 
illumination means with red, green and blue light. 

6. A device according to any one of the preceding claims wherein the frame rate of 
the electrically addressed spatial light modulator means is greater than the frame rate of 
the two dimensional image formed at the screen. 

7. A device according to any one of the preceding claims in which the means for 
producing computer generated hologram images comprises a store of a plurality of pre- 
calculated computer generated holographic elements. 

8. A device according to any one of the preceding claims in which the means for 
producing computer generated hologram images is configured to produce computer 
generated hologram images for display on the electrically addressed spatial light 
modulator means that provide a regular array of pixels on the screen. 

9. A device according to claim 8 wherein the array of pixels on the screen is sub- 
divided into blocks and the image at the screen is formed by sequentially writing one or 
more blocks to the screen. 

10. A device according to any one of the preceding claims wherein the coherent 
illumination means comprises at least one laser. 

11. A device according to any one of the preceding claims wherein additional 
magnification optics are provided such that a magnified two dimensional image may be 
formed at the screen. 

12. A method of forming a two dimensional image on a screen comprising the steps 
of; 
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i) illuminating an electrically addressed spatial light modulator means with coherent 
light, 

ii) displaying a computer generated hologram image on the electrically addressed spatial 
light modulator means so as to dif&act light therefrom, and 

iii) using optics to direct light diffracted by the electrically addressed spatial light 
modulator means to a screen, 

whereby the electrically addressed spatial light modulator means is arranged to display 
an image or images that produce a two dimensional image at the screen. 

13. A device for forming a two dimensional image at a screen as substantially 
hereinbefore described with reference to figures 2 and 3. 
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